Adaptive coding of reward value by dopamine neurons.
نویسندگان
چکیده
It is important for animals to estimate the value of rewards as accurately as possible. Because the number of potential reward values is very large, it is necessary that the brain's limited resources be allocated so as to discriminate better among more likely reward outcomes at the expense of less likely outcomes. We found that midbrain dopamine neurons rapidly adapted to the information provided by reward-predicting stimuli. Responses shifted relative to the expected reward value, and the gain adjusted to the variance of reward value. In this way, dopamine neurons maintained their reward sensitivity over a large range of reward values.
منابع مشابه
Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum
Learning to optimally predict rewards requires agents to account for fluctuations in reward value. Recent work suggests that individuals can efficiently learn about variable rewards through adaptation of the learning rate, and coding of prediction errors relative to reward variability. Such adaptive coding has been linked to midbrain dopamine neurons in nonhuman primates, and evidence in suppor...
متن کاملMidbrain dopamine neurons signal aversion in a reward-context-dependent manner
Dopamine is thought to regulate learning from appetitive and aversive events. Here we examined how optogenetically-identified dopamine neurons in the lateral ventral tegmental area of mice respond to aversive events in different conditions. In low reward contexts, most dopamine neurons were exclusively inhibited by aversive events, and expectation reduced dopamine neurons' responses to reward a...
متن کاملDopamine reward prediction error coding
Reward prediction errors consist of the differences between received and predicted rewards. They are crucial for basic forms of learning about rewards and make us strive for more rewards-an evolutionary beneficial trait. Most dopamine neurons in the midbrain of humans, monkeys, and rodents signal a reward prediction error; they are activated by more reward than predicted (positive prediction er...
متن کاملSubjective neuronal coding of reward: temporal value discounting and risk.
A key question in the neurobiology of reward relates to the nature of coding. Rewards are objects that are advantageous or necessary for the survival of individuals in a variety of environmental situations. Thus reward appears to depend on the individual and its environment. The question arises whether neuronal systems in humans and monkeys code reward in subjective terms, objective terms or bo...
متن کاملDopamine neurons coding prediction errors in reward space , but 15 not in aversive space : a matter of location ? 16
2 3 4 5 6 7 8 9 10 11 12 13 14 Dopamine neurons coding prediction errors in reward space, but 15 not in aversive space: a matter of location? 16 Joachim Morrens 17 Graduate student Cognitive and Decision Sciences, Division of Psychology and Language Sciences, Faculty of Brain Sciences, 18 University College London 19 [email protected] 20 21 Target article: 22 Fiorillo CD. Two Dimensi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Science
دوره 307 5715 شماره
صفحات -
تاریخ انتشار 2005